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ABSTRACT 



Sixty Naval Postgraduate School students served in a verbal discrimi- 
nation (VD) experiment with 2-, 3-» ai^d 4-v/ord items at presentation rates 
of or 4 bits of information per second. Half the items had similar and 
half, dissimilar words. Based on information theory, lists of different 
lengths were prepared for 2-, 5-» and 4-word items. The lists were eqviated 
for overall load at 20 bits of information. Performance was consistent 
with the equal-load hypothesis and a differential of two was observed be- 
cause of the rate factor. Analysis of percent correct responses revealed 
a significance for the item length main effect which was at variance with 
the null hypothesis of no difference borne out by the information analysis. 



2 



TABLE OF CONTENTS 



I. IICTHODUCTICN 6 

II. METHOD 8 

A. 7TORD LISTS 8 

B. CONDITIONS AND PROCEDURES 10 

C. SUBJECTS 11 

III. RESULTS 11 

IV. CONCLUSIONS 26 

APPENDIX A: SUBJECT’S KSTRUCTIONS 2? 

APPEl^DIX B: NUj/IBER OF CORRECT RESPONSES PER 

SUBJECT OVER TRIALS 28 

APPENDIX C: DISTRIBUTION OF CHOICES FOR EACH 

TEST OVER TRIALS 34 

BIBLIOGRAPHY 40 

INITIAL DISTRIBUTION LIST — 41 

FORM DD 1475 45 






LIST OF TABLES 



TABLE 

I. Word Lists for 2-, 5-» and 

4-word Treatments 9 

II. Time Intervals for Item Presentation — 10 

III. Percent of Correct Responses per Trial 

by Presentation Rate and Item Length 11 

IV. Percent of Correct Responses per Trial 

by Presentation Rate 12 

V. Percent of Correct Responses per Trial 

by Item Length 12 

VI. Analysis of Variance of Percent Correct 

Responses 17 

VII. A Posteriori Distribution of Initial 

Choices over Word Lists 18 

VIII. Uncertainty U, for 2-, 3-» and 4-word Items 

with Subjects (n) r= io — 19 

IX. Uncertainty Remaining per Presentation 

Rate over Trials 22 

X. Analysis of Variance of Uncertainty 

Remaining 25 



4 



LIST OF FIGURES 



FIGURE 

1 . Percent Correct Responses at a 

Presentation Rate of ^ Bits/sec 13 

2. Percent Correct Responses at a 

Presentation Rate of ^ Bits/sec I4 

3. Percent Correct Responses at the 

Two Presentation Rates — — — — — — _ — I5 

4. Percent Correct Responses per Item Len^h I6 

5. Uncertainty Remaining at the 

Two Presentation Fiates 20 

6. Uncertainty Remaining per Item Length 21 

7. Uncertainty Remaining at a 

Presentation Rate of ^ Bits/sec 24 

8. Uncertainty Remaining at a 

Presentation liate of ^ Bits/sec 25 



5 



I. INTRODUCTION 



Verbal learning is a form of learning in which all persons engage, and 
which is an integral part of educational procedures. Verbal discrimination 
(VD) is a method of presenting verbal material for learning. A set of 
words (called an item) is presented to the subject, and he must select the 
one that has been arbitrarily selected as correct by the experimenter. ^ A 
VD list of items is selected and presented to the subject; one complete 
presentation of the list is called a trial and on successive trials the 
words within an item and the items themselves are presented in different 
orders. Some studies have used a blank interval between presentations of 
each item. 

On the first trial of a VD task the subject is requested to make a 
guess for each item as to the correct word. In the contingent method, his 
response, if correct, is usually reinforced by the experimenter v/ho records 
each response the subject makes. In subsequent trials, it is hoped that 
the subject will learn the correct words in the list throu^ this rein- 
forcement and that the experimenter will be able to analyze these responses 
in order to measure the amount of learning incurred. 

Learning difficulty varies as the number of choices within each item 
(iftiderv/ood and Freund I969). Zacks (1969) has shown tr'at the total learn- 
ing time tends to be invariant over various conditions of practice for a 
fixed task load. Gray (1971) has demonstrated that information analysis 
of VD tasks provides additional information over conventional methods of 
analyzing VD learning. For example, the information measure provides an 

^The usual method is by use of a random choice mechanism. 
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absolute measure of learning regardless of the number of alternatives, 
whereas a measure such as the percentage of correct responses will vary 
according to the nimber of alternatives. Information measures, when the 
responses are summed over individvials, also provide information regarding 
the patterning of choices over all the alternatives considered simviltane- 
ously. That is, when the initial probability of choice for each word in 
a VD list can be estimated, the transfer of information contained within 
the list may then be raeasm-ed by the distribution of responses among 
choices over repeated trials. Thus, learning can be analyzed as the re- 
duction in uncertainty of subjects' responses from the uncertainty initially 
present in the item. 

If all the choices v/ithin an item are equally likely, then the in- 
formation content of the item is simply defined as 

I = log2N 

where N equals the number of words within the item. Hence, a 2-word item 
has 1 bit of information; a 5-word item, 1.585 bits; a 4-word item, 2 bits, 
etc. 

In the general case, considering a list of m items, each containing 
n-words, the information content wo\ild be 
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n 

E (p^iog^p.) 

i=1 ^ 



where k is the k-th item within the list and p^ is the probability of 
occurrence of the i-th word within the k-th item. may also be expressed 
as the a priori probability of choice for each v/ord within the VP item. 
Using these notions, this study examined the learning of 2-, 3-» and 4- 
word items using two information (stimulus) presentation rates. This is 
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in contrast to Gray's (1971) study in which he used two presentation times 
regardless of the information content of the stimulus. V/hen the informa- 
tion load for each list is approximately the same and the information 
presentation rate is constant (regardless of the nximber of words in an 
item) , there should be no difference in the information presentation rates 
difference in performance should be proportional to the differences in 
presentation rates. 



II. METHOD 



A. WORD LISTS 

Three word lists (Table I), one for each of the 2-, 3-> and 4-word 

2 

treatments, constrained to a maximum uncertainty of 20 bits , were con- 
structed. For the uncertainty level selected, lists of 20, 12, and 10 VD 
items were required for the 2-, 3-» and 4-word treatments, respectively. 

To insure the equal a priori probability of selection on the first trial 
and to reduce the rate of learning bias (Sidowski, 1966), three criteria 
Y/ere used in determining the words in each list. First, these words were 
selected from categories having at least a 0.9 correlation over test sub- 
jects in the category norms for verbal items compiled by Battig and Mon- 
tague (1969). Secondly, similarity v;as established by selecting the words 
of an item from a single category. Half of the items in each list were 
composed in this manner; the remaining items contained dissimilar group- 
ings. Finally, the frequence of occurirence of each word in v/ritten ma- 
terial vfas examined using the Thorndike and Lorge (1944) general count. 



In order to maintain list compatability for similar and dissimilar 
words, the 5-word VD list contained 19.O2 bits of xuicertainty. 
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TABLE I 



WORD LISTS FOR 2>, 3-» AITO 4-TORD TREATOIEI^TS 





TV/O-ffORD TREATI^JTS 




murder 


wine* 


juice 


doll* 


apple 


river*' 


book 


lake* 


iron 


yard->^ 


nail 


swim* 


tea 


coffee 


temple 


rock* 


table 


chair 


cotton 


salt* 


mother 


father 


bus 


gun* 


cat 


dog 


water 


door* 


eye 


head 


car 


train 


foot 


mile 


red 


blue 


com 


bean 


hour 


minute 




THREE-WORD TREAT?®11TS 




door 


temple 




water* 


brother 


mother 




father 


green 


blue 




red 


lake 


book 




table* 


cotton 


hours 




salt* 


apple 


knife 




cat* 


iron 


yard 




doctor* 


eye 


head 




foot 


minute 


hour 




second 


hill 


river 




rock 


boat 


train 




car 


nail 


oil 




swim* 




FOUR-WORD TREATI.IEIITS 




mother 


sister 


hoiir 


father 


door 


private 


temple 


water* 


eye 


foot 


nose 


head 


swim 


nail 


wine 


oil* 


yard 


doctor 


iron 


book* 


yellow 


blue 


green 


red 


lake 


rock 


river 


hill 


cotton 


salt 


house 


table* 


cat 


murder 


knife 


apple* 


year 


minute 


hour 


second 



*Denotes dissimilar word groups.. First word in each item 
was used as the correct response with the experiment. 
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In this respect, all words were required to be members of the AJi or A 
frequency group. 

B. CONDITIONS AND PROCEDURES 

From each of the three word lists two treatments were constructed. 

One treatment from each list was randomly assigned to one of t?/o presen- 
tation rate groups, yielding six treatments. Each treatment consisted of 
two copies of four random arrangements of the items v/ithin the respective 
list and a random arrangement of the words vdthin each item; thus, eight 
presentations of each list were xised to examine the trends in the results. 

For each list, one w’ord within each item v/as designated correct by 
random determination, and remained correct throughout the experiment. 

Prior to each treatment, the subjects were read a set of instructions 
on the task and the procedures (Appendix A). The subjects were tested in- 
dividually using a Lafayette high-speed memory drum. The discrimination 
item was presented for a fixed- time interval followed by an inter-item 
interval of the same duration as noted in Table II. The subject viewed 

TABLE II. 

TIf.tE INTERVAI.S FOR ITEM PRESENTATION 



ITEI.I 


PRESEITATION 


RATE 


TYPE 


i BITS/SEC 


i BITS/SEC 


2-WORD 


1.0 


2.0 


3-WORD 


1.6 


3.2 


4-WORD 


2.0 


4.0 



the words in an item, chose v;hat he considered the correct word and told 
his choice to the experimenter. This declaration was reinforced with the 
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verbal response "correct" from the experimenter when the right word was 
chosen; otherwise, there was no response from the experimenter. Each re- 
sponse f rom the subject was recorded and formed the basic data for the 
analysis. There were no intertrial breaks. 

C. SUBJECTS 

The 60 subjects were graduate level students at the Naval Postgraduate 
School. They were volunteers and randomly assigned to six study groups, 
of 10 subjects each, associated with each of the six treatments. 

III. RESULTS 

The results will first be analyzed according to the growth of correct 
responses; then an analysis in terras of information transfer findings will 
be made. The percent correct responses per trial by item length and pre- 
sentation rate, by presentation rate, and by item length are shown in Tables 
III, IV and V and Figures 1 , 2 , 5 » and 4 respectively. 

TABLE III 

PERCIIJT OF CORRECT PESPONSES PER TRIAL 
BY PRESENTATION RATE AND I^PEM LENGTH 



TRIAL 


i BITS/SEC 

2 -V.ORDS 3 -V/ORDS A-V.'ORDS 


2 -N 70 RDS 


BITS/SFC 
3 -V,' 0 RDS 4 -V.' 0 RDS 


1 


51.0 


54.2 


19.0 


47.5 


35.8 


25.0 


2 


55.5 


59.2 


53.0 


67.5 


46.7 


32.0 


5 


59.0 


55.0 


56.0 


73.5 


44.2 


46.0 


4 


61.5 


52.5 


50.0 


85.0 


57.5 


56.0 


5 


64 . 5 


57.5 


49.0 


85.0 


59.2 


67.0 


6 


64.5 


65.5 


49.0 


87.5 


66.7 


65.0 


7 


67.0 


70.8 


58.0 


91.0 


74.2 


75.0 


8 


74.0 


71.7 


60.0 


93.5 


80.8 


81.0 



1 



TABLE IV 



PERCEtv^T OF CORRECT RESPONSES PER TRIAL 
BY PRESENTATION RATE 



TRIAL 


PRESENTATION R>\TE 
i BITS/SEC BITS/SEC 


1 


58.6 


58.8 


2 


45.5 


55.1 


5 


52.4 


58.6 


4 


56.2 


70.2 


5 


58.8 


75.3 


6 


60.5 


75.7 


7 


66.0 


82.4 


8 


70.0 


86.9 



TABLE V 

PERCEl'IT OF CORRECT RESPONSES PER TRIAL BY ITFI.I LEIXTH 



TRIAL 


2-VvORD 


ITEM LENGTH 
5-V.’0RD 


4-WORD 


1 


49.5 


35.0 


22.0 


2 


57.5 


43.0 


32.5 


5 


66.5 


49.6 


41.0 


4 


75.5 


55.0 


53.0 


5 


74.8 


58.4 


58.0 


6 


76.0 


65.0 


56.0 


7 


79.0 


72.5 


66.5 


8 


85.8 


76.5 


70.5 



12 



100 





U U U 

0 o o 
> rs 

1 I I 

CM 



CO 



-VO 



ITN 



\ i 




\ 



\ 



\ 



CO 



Cj 

•H 



lT\ o LT\ 

irv Osj 



4O9JJO0 %UB0dB^ 



5 



Figure 1. Percent Correct Responses at a Presentation Rate of ^ Blts/Sec 
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Figure 2. Percent Correct Responses at a Presentation Rate of v Blts/Sec 
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Ficure 3. Comparison of Percent Correct Responses at the Tvjo Presentation Rate 
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Figure 4. Percent Correct Pesponses per Item Length 



As demonstrated by Gray (1971)* the analysis of the percent correct 
data (Table Vl) shows that the effects for rate, item len^h, trials, and 
rate x item len^h are significant with a probability less than 0.01, All 
except the significant interaction were expected. The primary pvirpose of 
this analysis, however, was to show the significance of item length as a 
variable, since the information analysis to follow predicts the null hypoth- 
esis-(no difference) for item length. 



TABLE VI 

ANALYSIS OF VARIANCE OP PERCENT CORRECT RESPONSES 



SOURCE 


df 




P 


RATE (a) 


1 


1254.61 


71.22*- 


ITEIi LENGTH (B) 


2 


1746.77 


80.33* 


TRIALS (C) 


7 


1159.55 


53.52* 


A X B 


2 


202.07 


9.30* 


A X C 


7 


44.98 


2.07 


B X C 


14 


26.45 


1.22 


A X BC 


14 


21.76 




TOTAL 


47 


^significant 





The first step in the information analysis was to compute the relative 

/ 

frequency that each choice was selected on its first presentation. For 
each item, each word within an item was arbitrarily designated as word 1, 

2, 5» or 4 (depending on the number of choices). Chi-square tests indicated 
that the null hypothesis of equally likely alternatives could not be re- 
jected ( ^ -c .95) Thus, the a priori distribution is upheld by the 
empirical results (a posteriori distribution). The a posteriori probabil- 
ity for each classification is presented in Table VII. 
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TABLE VII 



A POSTERIORI DISTRIBUTION OVER ’.VORD LISTS 



LIST 


WORD 1 


7/ORD 2 


WORD 5 


WORD 4 


CHI-SQUARi: 


4 wd 


21.00 


25.00 


28.50 


25.50 


0.90* 


3 wd 


34.15 


57.10 


28.75 




1.18* 


2 wd 


50.25 


49.75 






1.15* 



* 2 

X < 0.95 



Computing the information transferred required the determination of 
the distribution of choices for each item on each trial. This is accom- 
plished by determining the number of times each wosrd v?ithin an item v;as 
chosen during each trial within each of the six tasks. This forms a per- 
mutation of choices of either two, three or four words. Using tables of 
^i^°^2^i* uncertainty for the k-th item is 

\ - I! PiloS^Pi 

i 

where i is the arbitrary designation of each word within the item. Table 
VIII gives all possible permutations of four numbers whose sum is equal to 
10 (the number of subjects involved in each treatment) and their values of 
Uj^. It is obvious that when perfect learning occurs, p^ for the correct 
choice is 1 .00 and that there is no longer any uncertainty present in the 
item. Thus, for each test, the vincertainty remaining after each trial is 

U - E 

k 
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TABLE VIII 



UMCERTAINTY Uj^ FOR 2 ~, 5-, AOT) 4-WORD ITE?i!S 



WITH SUBJECTS (iQ = 10 



PER 1 . 1 UTATI 0 N j 
OF CHOICES I 


- E PiiosaPi 


PERI 4 DTATI 0 K 
OP CHOICES 


- E PiiPSaPt 


0 10 0 I 


0.4690 


5 


5 


2 


0 


1.4855 


8 2 0 0 j 


0.7219 


4 


4 


2 


0 


1 . 5220 


7 5 0 0 I 


O.88I5 


6 


2 


1 


1 


1.5710 


8 110 1 


0.9219 


4 


5 


5 0 


1.5710 


6400 1 


0.9710 


5 


5 


1 


1 


1.6855 


5500 


1.0000 


4 


4 


1 


1 


1.7220 


7210 


1.1568 


5 


2 


2 


1 


1.7610 


6510 1 


1.2955 


4 


5 


2 


1 


1.8465 


7111 • 


1 . 5568 


5 


5 


5 


1 


1.8955 


5410 1 


1.5610 


4 


2 


2 


2 


1.9220 


6 2 2 0 1 


1.5710 


5 


5 


2 


2 


1.9710 



The U values for each treatment are shovm in Table IX. Figures 5 and 6 
graphically present this data. 
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Figure 5. Uncertainty Remaining of the Presentation Rates 
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TABLE IX 



BI^CERTAINTY REMAINING PER PRESENTATION RATE OVER TRI.iiS 



TRIAL 


^ BITS/SEC 


i BITS/SEC 


4-WORDS 


2-WORDS 


3-WORDS 


4-WORDS 


2-WORDS 


3-WORDS 


1 


17.8 


l6. 5 


17.4 


18.3 


16.6 


17.1 


2 


19.5 


15.6 


17.6 


16.1 


15.1 


18.6 


5 


16.6 


15.5 


16.6 


14.2 


16. 1 


15.6 


4 


16.7 


15.4 


15.7 


10.7 


14.5 


14.9 


5 


16.7 


14.5 


15.7 


10.9 


16.0 


11.2 


6 


17.3 


13.6 


14.6 


9.1 


11.0 


12.3 


7 


15.9 


11.7 


12.4 


7.9 


8.9 


9.5 


8 


15.1 


10.6 


15.5 


5.7 


5.6 


6.4 



This experiment conforms to a 2 x 3 x 8 randomized factorial fixed 
effects model} thus an analysis of variance over trials v.'as conducted 
using nonrepeated measures. The basic datum for the analysis was the 
uncertainty remaining for each of 6 (item length 3j x presentation 
rate ) treatments for each of eight trials making a total of 47 
degrees of freedom. The results of the analysis are shown in Table X. 
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TABLE X 



ANALYSIS OP VARIANCE OP BNCI^RTAINTY RET.IAINING 



SOURCE 


df 


MS 


F 


RATE (a) 


1 


105.25 


76.48* 


ITEM LENGTH (B) 


2 


2.81 


2.08 


TRIALS (C) 


7 


46.22 


54.17* 


A X B 


2 


18.06 


15.55* 


A X C 


7 


8.64 


6.58 


B X C 


14 


1.60 


1.18 


A X B X C 


14 


1.54 




TOTAL 


47 







*p-=0.01 

The resxilts of Table X indicate a statistical significance for the 
rate and trial main effects (Figure 5 )t while the item length main effect 
was not statistically significant; this insignificance can be seen graph- 
ically in Figure 6 and is explained by the fact that the information to be 
transferred is a constant in each treatment. The rate (Pigujre 7 ) main 
effect significance is apparent since twice as much information had to be 
processed at the faster rate of ^ bits/sec. The significance of the trials' 
main effect occurs due to the learning process (i.e., the imcertainty re- 
duction J which takes place over each trial and at an increased rate as 
learning progressed. 

The rate by item length interaction significance is apparent in Fig- 
ures 7 and 8 by a juxtaposition of the 2-word treatments relative to the 
other treatments for the two rates. The rate by trials interaction signi- 
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Figure 7- Uncertainty Remining at 
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Fiiji;re 8. Uncertainty Reiraining at a Presentation Rate of i Bits/ Sec 



ficance is readily apparent in Fig\ire 7» and is consistent with expec- 
tations. 



IV. DISCUSSION 

This experiment has demonstrated that the information measure provides 
an absolute measure of learning regardless of the nximber of alternatives 
(i.e., item length), whereas the percentage of correct responses showed 
that the item length main effect is significant. Thus it was possible to 
quantify the difficulty of a VD item in terms of the uncertainty remaining 
after successive trials. This was accomplished by creating lists of equal 
information content (vrarkload) varying in length, differing in difficulty, 
and presented at distinct rates, resulting in making the work/rate condi- 
tion twice as high for the groups with the shorter processing times. The 
results were consistent with the equal workload quantifications and showed 
that the differential in work output (information transferred) was approx- 
imately a factor of tv/o. 

The study has shown that information analysis provides a viable vehicle 
for measuring learning in VD tasks. Since a certain amount of basic educa- 
tion consists in rote learning, it is suggested that this type of analysis 
could be useful in future research to quantify learning tasks and progress. 
It should be possible to devise testing procedures to measure the rate of 
learning an individual can accomplish in order to determine such educa- 
tional functions such as curricula, student placement in stratified class- 

\ 

es, teacher-student workloads, and the like. Similar applications may be 
possible in training situations. 
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APPEI^'DIX A 



SUBJT.CT‘S INSTRUCTIONS 

You are to participate in a verbal discrimination experiment. You 
will be shown one series of either all 2-word items, all 3- word items, or 
all 4-word items, each item being distinct within the series. This series 
is 10, 12, or 20 items long and will be repeated in various orders for 
eight consecutive trials. Within each item, one word has been arbitrarily 
selected as "correct". Each item will be presented for a fixed length of 
time, followed by a blank space of the same duration. 

It is your task to viev/ the words in each item and guess which one is 
"correct". Once you have made a choice, announce it to the experimenter. 

If your response is "correct", the experimenter will tell you that you are 
"correct"; otherwise, no answer will be given. In each item, the "correct" 
response word will remain the same throughout the experiment. 

Do you have any questions? If not, relax and await the experimenter's 
command to begin. 

I wish to thank you for your assistance and would appreciate it if you 
would not discuss this experiment with other students who might participate 
in this study. 
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KWffiER OF CORRECT RESPONSES PER SUBJECT OVER TRIALS 



APPENDIX B 
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3-WORD LIST AT ^ BITS/SEC 
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4-VJORD LIST AT ^ BITS/SEC 
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2-VJORD LIST AT ^ BITS/SEC 
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3-WORD LIST AT f BITS/SEC 
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4-V/OHD LIST AT v BITS/SEC 
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APPEia)IX c 



DISTRIBUTION OP CHOICES FOR EACH TEST OVER TRIALS 
2-VJORD LIST AT i BITS/SEC 







1 




2 




3 


TRIAL 

4 




5 




6 




7 




e 


ITEl- 

KO. 


1 


2 1 


1 


2 


1 1 


2 


WORDS 

1 1 2 1 


1 


2 


1 1 


2 


1 1 


2 


1 1 


2 


1 


9 


1 


4 


6 


7 


3 


10 


0 


10 


0 


10 


0 


10 


0 


9 


1 


2 


6 


4 


6 


4 


2 


8 


3 7 


6 


4 


7 


3 


3 


7 


6 


4 


3 


5 


5 


6 


4 


3 


7 


4 6 


8 


2 


5 


5 


6 


4 


7 


3 


4 


7 


3 


3 


7 


3 


7 


7 


3 


6 


4 


4 


6 


5 


5 


5 


5 


5 


3 


7 


7 


3 


5 


5 


7 


3 


5 
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